Multi-domain execution of tests on electronic devices

ABSTRACT

A device under test is divided into multiple test domains, and test conditions for each of the multiple test domains are defined separately, so that each test domain has its own test pattern, timing data, and other test conditions. Each test domain can start and stop independently, and run at different speeds. Further, triggers are used to specify how the tests executed in the different test domains interact and communicate with one another. Any test domain can generate or wait for a trigger from any other test domain (including the CPU).

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates generally to electronic device testing,and more particularly, to multi-domain execution of tests on electronicdevices.

2. Description of the Related Art

A test system having a multiple instrument platform represents asignificant advance in the art. One example of such a test system isdescribed in U.S. patent application Ser. No. 10/222,191, entitled“Circuit Testing with Ring-Connected Test Instrument Modules,” filedAug. 16, 2002, the entire contents of which are incorporated byreference herein.

In this test system 100, illustrated in FIG. 1, a test head interfacemodule 110 and a plurality of instruments (collectively referred to as120; individually referred to as instrument A, instrument B, andinstrument C) are connected together over a ring bus 130. The test headinterface module 110 houses a global clock 140 to which all of theinstruments 120 are synchronized.

During testing, the test system 100 operates under the control ofsoftware, e.g., a test program. The test program specifies the testconditions, including the test data to be supplied to a device undertest (DUT) 150, the expect data to be compared with the response signalsfrom the DUT 150, and timing information indicating when the test dataare to be supplied and when the response signals are to be strobed.

With a multiple instrument platform, the designer of a test has theflexibility to simultaneously test different pins of the DUT 150 withdifferent test data and to condition the triggering of this test withrespect to certain programmed events or certain events detected at theDUT 150. In addition, the test system having a multiple instrumentplatform is able to accommodate testing of pins at different clockrates. For example, if the core part of the DUT 150 operates at 250 MHzand other parts of the DUT 150 operates at 100 MHz, the pinscorresponding to the core part are tested with instruments running at250 MHz and the pins corresponding to the other parts are tested withinstruments running at 100 MHz.

SUMMARY OF THE INVENTION

The present invention provides methods for defining and carrying outmulti-domain tests on electronic devices. According to an embodiment ofthe present invention, the electronic device is divided into multipletest domains, and test conditions for each of the multiple test domainsare defined separately, so that each test domain has its own testpattern, timing data, and other test conditions. Triggers are used tospecify how tests executed in the different test domains interact andcommunicate with one another. For example, the initiation of a test inone test domain may be conditioned on a certain event detected inanother test domain.

The multi-domain execution (“MDE”) methods according to the inventionprovide several advantages over the prior art. First, it provides testdesign flexibility. In the prior art, all parts of the electronic devicebeing tested are required to start at the same time and share more orless common test conditions. Test patterns and timing conditions aredefined for the whole device, and a master test domain is often used tocontrol other test domains. In the invention, the multiple test domainscan start independently, run at different speeds and stop independently.Each test domain has its own set of test conditions to make thispossible. Further, any test domain can generate or wait for a triggerfrom any other test domain (including the CPU), so there is no mastertest domain. Second, the task of defining the test conditions for theentire test is broken up into manageable pieces. Instead of having todefine test conditions for one big test, the test designer is nowpermitted to define test conditions for one test domain at a time.Third, the task of managing test program development is much easier,because the test program development can be split up by test domain andtest conditions defined for one test domain may be reused in other testdomains.

The present invention further provides a computer-readable medium havingprogram instructions to be executed on a test apparatus that implementMDE. In one embodiment, the program instructions comprise XML blocks,which during execution are passed as software objects. An XML block isdefined for each test domain and specifies the test pattern, timingdata, and other test conditions for that test domain. An XML block isalso defined for each of the triggers and defines the trigger generator(the test component that generates the trigger) and the trigger actor(the test component that acts on the trigger).

BRIEF DESCRIPTION OF THE DRAWINGS

So that the manner in which the above recited features of the presentinvention can be understood in detail, a more particular description ofthe invention, briefly summarized above, may be had by reference toembodiments, some of which are illustrated in the appended drawings. Itis to be noted, however, that the appended drawings illustrate onlytypical embodiments of this invention and are therefore not to beconsidered limiting of its scope, for the invention may admit to otherequally effective embodiments.

FIG. 1 is a block diagram of a test system having test instrumentsconnected in a ring configuration;

FIG. 2 is a block diagram of a test system having test instrumentsconnected in a ring configuration and a DUT divided into multiple testdomains;

FIG. 3 illustrates graphically the timing of tests carried out inmultiple test domains;

FIG. 4 shows different components of a test program that implementsmulti-domain testing;

FIG. 5 is a simplified test script that implements multi-domain testing;

FIG. 6 is a portion of the test script that defines an object class usedin multi-domain testing;

FIG. 7 is a simplified triggers data block used in multi-domain testing;

FIG. 8 is a simplified multi-domain execution data block used inmulti-domain testing; and

FIG. 9 is a flow diagram illustrating the execution steps of a samplemulti-domain test.

DETAILED DESCRIPTION

FIG. 2 is a block diagram of the test system 100 showing an illustrativeenvironment in which the methods according to the invention can beapplied. The DUT 150 in this example is a mixed signal device comprisinga digital section and an analog section. The digital section includesthe CPU core, the I/O bus, and other digital components of the DUT 150and the analog section includes the video processing section and theaudio processing section.

FIG. 2 also shows the functional division of the DUT 150 into multipletest domains. Test domain I comprises the digital section of the DUT 150and instrument A that is connected to the pins of the digital section.Test domain II comprises the video processing section of the DUT 150 andinstrument B that is connected to the pins of the video processingsection. Test domain III comprises the audio processing section of theDUT 150 and instrument C that is connected to the pins of the audioprocessing section. Each of these test domains has its own test pattern,timing data, and other test conditions defined for it in the testprogram.

The tests that are carried out in the different test domains interactand communicate with each other through triggers that can be generatedduring execution of tests in any of the test domains. For example,instrument A can generate a trigger during a test executed in testdomain I to instruct the initiation of a test in test domain II, andinstrument B can generate a trigger during a test executed in testdomain II to instruct the initiation of a test in test domain III. Ingeneral, any test domain can generate a trigger and carry out programmedinstructions in response to a trigger. The trigger can initiate any typeof action in a test domain, including initiation of a test, terminationof a test, and exiting a loop defined in a test.

FIG. 3 illustrates graphically the timing of tests carried out indifferent domains in a situation where the multi-domain testingaccording to the invention is applied to six different test domains:Core, IO Bus, Video In, Video Out, Audio In, and Audio Out. At timet=t0, the tests in the test domains for Core and IO Bus are initiated.During the test in the Core test domain, a trigger is issued for teststo be initiated in the test domains for Video In and Audio In at t=t1.At t=t1, the tests in the test domains for Video In and Audio In areinitiated. During the test in the Video In test domain, a trigger isissued for the test to be initiated in the Video Out test domain att=t2. At t=t2, the tests in the Video Out test domain is initiated.During the test in the Audio In test domain, a trigger is issued for thetest to be initiated in the Audio Out test domain at t=t2. At t=t2, thetest in the Audio Out test domain is initiated.

The termination of the tests in the different test domains may beprogrammed to occur at different times. In the example shown in FIG. 3,the termination of the test in the Video Out test domain occurs at t=t3,and the termination of the tests in the test domains for Video In, AudioIn, and Audio Out occurs at t=t4. The termination of the tests in thetest domains for Core and IO Bus occurs at t=t5.

Also, the termination of a test may be conditioned upon an eventoccurring in another test domain. In the example shown in FIG. 3, thetest in the Video In test domain is programmed to terminate upon receiptof a trigger that is generated when the test in the Video Out testdomain terminates. Such a trigger is issued at t=t3 in the Video Outtest domain and received at t=t4 in the Video In test domain. Uponreceipt of this trigger, the test in the Video In test domain isterminated.

The speed at which each of the tests in the different test domains iscarried out may be different because these are independent test domains,such that test speed variation is permitted and may be designed into thetest program. Thus, if the Core test domain runs at 250 MHz and the I/OBus test domain runs at 100 MHz, both of these test domains may betested by specifying timing data corresponding to 250 MHz for the Coretest domain and specifying timing data corresponding to 100 MHz for theI/O Bus test domain.

Accordingly, the digital test setup is independent from the analog testsetup. Further, different analog signals (video, audio, RF, etc.) canhave independent test domains with independent test conditions. Triggersallow the test designer the flexibility to coordinate the start and stopconditions and to send messages across different test domains.

The components of a test program 200 that implement multi-domain testingis shown schematically in FIG. 4. It includes a test script 210,commonly referred to as a test template, a triggers data block 220, anMDE data block 230, various other data blocks 240, and test patterns250. In the embodiment of the invention described herein, theprogramming language for the test script 210 is Java® and the testscript 210 belongs to a Java® class named TestTemplate. Also, the datablocks 220, 230, 240 are XML data blocks that are passed as Java®objects during run-time.

FIG. 5 is a simplified version of the test script 210 and shows theexecuteTest( ) method of the TestTemplate Java® class that executes atest whose parameters are generally defined in the “testContext”parameter, and the executePattern( ) method that executes a testpattern. In Step 211, the instruments that will generate and wait fortriggers are programmed using Java® objects which were previouslyconverted from the triggers data block 220. In Step 212, the instrumentsare programmed according to the test conditions specified in the testdomain they are associated with using software Java® objects which werepreviously converted from the MDE data block 230. The executePattern( )method is called in Step 213.

The executePattern( ) method begins the execution of the test pattern bycalling the start( ) method of the Triggers object in Step 214. TheTriggers object belongs to a Java class that is defined as shown in FIG.6. One of the methods defined in the Java class of FIG. 6 is the start() method. In Step 215, the start( ) method invokes another method,generateSync(“StartDigital”), which causes a trigger identified as“StartDigital” to be generated.

FIG. 7 is a simplified version of a triggers data block 220. This datablock is stored in XML format and defines four different triggers. The“StartDigital” trigger is defined in section 221. The “StartAnalog”trigger is defined in section 222. The “CaptureDone” trigger is definedin section 223. The “EndOfTest” trigger is defined in section 224. Eachtrigger definition specifies how the trigger is generated (between the<Generators> and </Generators> tags) and how the trigger is acted upon(between the <Actors> and </Actors> tags). The “StartDigital” trigger,for example, is defined to be generated by the CPU and, in response tothis trigger, a hardware event is generated within the instrument suchthat it starts executing a predefined pattern. The reaction of theinstrument to a trigger is programmed in Step 211 of FIG. 5.

FIG. 8 is a simplified version of an MDE data block 230. This data blockis stored in XML format and specifies the name and the test conditionsof three test domains. The first test domain 231 is defined with thename “allPinsDigital.” Its test pattern is specified as “DigitalPattern”and its timing data is specified as “DigitalTiming.” The second testdomain 232 is defined with the name “SrcSignalsMux0.” Its test patternis specified as “AnalogSourcePattern” and its timing data is specifiedas “AnalogSourceTIming.” The second test domain 232 has two other testconditions identified. They are “AnalogSourceDef” which defines thesource analog waveform and “AnalogSourceSetup” which specifies setupparameters for the source analog signal. The third test domain 233 isdefined with the name “MeasSignalsMux0.” Its test pattern is specifiedas “AnalogAcquirePattern” and its timing data is specified as“AnalogAcquireTIming.” The third test domain 233 has two other testconditions identified. They are “AnalogAcquireDef” which defines themeasuring analog conditions and “AnalogAcquireSetup” which specifiessetup parameters for the measuring analog signal.

FIG. 9 is a flow diagram illustrating the test execution steps of a testscript shown in FIG. 5, which uses: (i) the triggers Java® class definedaccording to FIG. 6, and (ii) Java® objects that are translated from thetriggers data block defined according to FIG. 7 and the MDE data blockdefined according to FIG. 8 and passed as parameters to the TestTemplateJava® class. In Step 301, the executeTest( ) method of the TestTemplateJava® class is initiated, and the executePattern( ) method is called(Step 304). Then, in Step 305, the executePattern( ) method begins thetest for a test domain using the start( ) method of the Triggers object.The start( ) method of the Triggers object invokes the method,generateSync(“StartDigital”), which causes a trigger identified as“StartDigital” to be generated (Step 306).

FIG. 7 shows that the “StartDigital” trigger is generated by the CPU andinitiates the test defined in the “allPinsDigital” test domain (Step307). FIG. 8 shows that the test pattern corresponding to the“allPinsDigital” test domain is specified as “DigitalPattern.” This testpattern generates the “StartAnalog” trigger and initiates the tests forall analog pins (Step 308). The tests for all analog pins correspond tothe tests defined in the “SrcSignalsMux0” test domain and the“MeasSignalsMux0” test domain.

The “CaptureDone” trigger is generated by the “MeasSignalsMux0” testdomain when the “CAPTURE_DONE” event is detected during the test (Step309), i.e., when the signal has captured a predefined number of samples.In response to this trigger, the CPU begins downloading captured dataand then terminates the analog test (Steps 310 and 311). The “EndOfTest”trigger is generated by the “allPinsDigital” test domain when completionof the digital pattern is detected during the test (Step 313). Inresponse to this trigger, the CPU terminates the digital test (Step314).

While the foregoing is directed to embodiments of the present invention,other and further embodiments of the invention may be devised withoutdeparting from the basic scope thereof, and the scope thereof isdetermined by the claims that follow.

1. A method of testing an electronic device, comprising: (a) designatingmultiple test domains for the electronic device; (b) defining a test foreach of the multiple test domains separately, each such definitionspecifying a test pattern and timing data to be used with the test; (c)defining triggers for initiating each test defined in (b); (d) executingthe tests and triggers defined in (b) and (c); wherein the test and thetriggers are defined as extensible markup language (XML) blocks andpassed as objects during (d); and (e) storing test and trigger resultsoperable for access by a user.
 2. The method according to claim 1,wherein the tests defined for at least two of the test domains specifytests carried out at different speeds.
 3. The method according to claim1, wherein the electronic device is a mixed signal device and one of thetest domains is an analog test domain and another of the test domains isa digital test domain.
 4. The method according to claim 3, wherein saidtests defined for at least two of the test domains specify tests carriedout at different speeds.
 5. A computer-readable medium having storedtherein program instructions to execute a method for testing anelectronic device comprising: (a) initiating a test for a first testregion of the electronic device at a first test instrument of saidapparatus; (b) generating a trigger at the first test instrument inresponse to an event associated with the first test region of theelectronic device; (c) initiating a test for a second test region of theelectronic device at a second test instrument of said apparatus inresponse to a receipt of the trigger at the second test instrument,wherein the program instructions comprise extensible markup language(XML) blocks, each of the XML blocks corresponding to a test for onetest region and specifying a test pattern and timing data to be usedwith the test for said test region; and (d) storing test and triggerresults operable for access by a user.
 6. The computer-readable mediumaccording to claim 5, wherein the program instructions define the testfrom the first test region separately for the test for the second testregion, each such test definition specifying a test pattern and timingdata to be used with the test.
 7. The computer-readable medium accordingto claim 5, wherein the program instructions further comprise XML blocksthat define triggers.
 8. The computer-readable medium according to claim5, wherein said initiating comprises executing a test pattern togenerate test signals to be supplied to the first region of theelectronic device.
 9. A computer-readable medium according to claim 8,wherein the event associated with the first test region comprises aprogrammed event in the test pattern.
 10. A computer-readable mediumaccording to claim 8, wherein the event associated with the first testregion comprises an event detected in outputs of the first test regionof the electronic device generated in response to the test signalssupplied to the first test region of the electronic device.
 11. Thecomputer-readable medium according to claim 5, wherein the test for thefirst test region is carried out at a first clock speed and the test forthe second test region is carried out at a second clock speed that isdifferent from the first clock speed.
 12. A computer-readable mediumhaving stored therein program instructions to be executed in anapparatus for testing an electronic device, said method comprising: (a)designating multiple test domains for the electronic device; (b)defining a test for each of the multiple test domains separately, eachsuch definition specifying a test pattern and timing data to be usedwith the test; (c) defining triggers for initiating each test defined in(b); (d) executing the tests and triggers defined in (b) and (c),wherein the test and the triggers are defined as extensible markuplanguage (XML) blocks and passed as objects during (d); and (e) storingtest and trigger results operable for access by a user.
 13. Thecomputer-readable medium as described in claim 12, wherein the testsdefined for at least two of the test domains specify tests carried outat different speeds.
 14. The computer-readable medium as described inclaim 12, wherein the electronic device is a mixed signal device and oneof the test domains is an analog test domain and another of the testdomains is a digital test domain.
 15. The computer-readable medium asdescribed in claim 14, wherein said tests defined for at least two ofthe test domains specify tests carried out at different speeds.
 16. Amethod for testing an electronic device, wherein said method comprising:(a) initiating a test for a first test region of the electronic deviceat a first test instrument of said apparatus; (b) generating a triggerat the first test instrument in response to an event associated with thefirst test region of the electronic device; (c) initiating a test for asecond test region of the electronic device at a second test instrumentof said apparatus in response to a receipt of the trigger at the secondtest instrument, wherein the program instructions comprise extensiblemarkup language (XML) blocks, each of the XML blocks corresponding to atest for one test region and specifying a test pattern and timing datato be used with the test for said test region; and (d) storing test andtrigger results operable for access by a user.
 17. The method asdescribed in claim 16, wherein the program instructions define the testfrom the first test region separately for the test for the second testregion, each such test definition specifying a test pattern and timingdata to be used with the test.
 18. The method as described in claim 16,wherein the program instructions further comprise XML blocks that definetriggers.
 19. The method as described in claim 16, wherein saidinitiating comprises executing a test pattern to generate test signalsto be supplied to the first region of the electronic device.
 20. Themethod as described in claim 19, wherein the event associated with thefirst test region comprises a programmed event in the test pattern. 21.The method as described in claim 19, wherein the event associated withthe first test region comprises an event detected in outputs of thefirst test region of the electronic device generated in response to thetest signals supplied to the first test region of the electronic device.22. The method as described in claim 16, wherein the test for the firsttest region is carried out at a first clock speed and the test for thesecond test region is carried out at a second clock speed that isdifferent from the first clock speed.